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The control of chemical dynamics requires understanding the effect of time-dependent transition 
rates between states of chemo-mechanical molecular configurations. Pumping refers to generating 
a net current, e.g. per period in the time-dependence, through a cycle of consecutive states. The 
working of artificial machines or synthesized molecular motors depends on it. In this paper we give 
short and simple proofs of no-go theorems, some of which appeared before but here with essential 
extensions to non-Markovian dynamics, including the study of the diffusion limit. It allows to 
exclude certain protocols in the working of chemical motors where only the depth of the energy well 
is changed in time and not the barrier height between pairs of states. We also show how pre-existing 
steady state currents are in general modified with a multiplicative factor when this time-dependence 
is turned on. 



I. INTRODUCTION 



Molecular cybernetics deals with the control and the steering of system of molecules. As part of systems chemistry it 
investigates models of chemical networks with time-dependent dynamics. A common application is found in the study 
i-G | of molecular motors or mcsoscopic machines. Here, chemical or electrical gradients repetitively and progressively 
^ ■ drive a system away from equilibrium in such a way that when the motor returns to its original configuration, a 
physical task performed by the machine is not undone 0, 0] . This technology is ubiquitous in nature in the form of 
translational and rotational movements, e.g. in muscle fibres, bacterial flagella and cilia [1, H| or to transport material 
within and across a cell membrane, either powered by solar energy (as in photosynthesis) or by chemical energy stored 
in molecular bonds (e.g. ATP). 

Artificial designs analogous to such motors use external time-dependent perturbations such as light, heat or 
chemical stimulus to drive the system [Bl-Q. It is thus relevant, in attempts to synthesize and control artificial 
molecular motors, to understand the relation between the external pumping and creation of systematic flows. 
Previously, similar questions were asked by Thouless OH, for electronic pumping. Astumian and Derenyi fill ] studied 
, charge transfer from a lower to a higher chemical potential by varying the gate and portal energies. Astumian also 
analyzed the adiabatic regime of ion pumping in externally driven protein structures [l2| and in a molecular motor 
based on a three-ring catenane |13l| . A general theory of adiabatic pumps in terms of geometrical phase was proposed 
^; by Sinitsyn and Nemenman |l4|. Chernvak and Sinitsyn [l5| have discovered that the adiabatic pumping currents 
become quantized at low temperatures. Generalizations beyond adiabatic regimes are so far limited to Markov models. 

(N ■ 

In the present paper we concentrate on no-go or no-pumping theorems, stating the absence of a net time-averaged 
current under certain protocols. We refer to the experiment by Leigh et al. Q on unidirectional motion in (2)- and (3)- 
catenanes. Rahav, Horowitz and Jarzynski flfij were the first to give a no-pumping theorem for jump processes with 
non-adiabatic pumping and generalization to diffusion processes |17| . This was further studied and systematized by 
• ■ Chernyak and Sinitsyn [l8[ so that the following general conclusion was reached: when the dynamics can be modeled 
\ as a Markov state system for which the transitions between states x and y have an Arrhenius-type time-dependence 

i— I . w t {x,y) = A(x,y)e k B T , A(x,y) = A(y,x) 

. £h ' with periodic time-dependent energy wells Gt{x) and with constant energy barriers as represented by the symmetric 
factors A(x,y), then the time-averaged current J{x,y) along every transition x — > y is zero. As a result, no net work 
$_i ' can be done with such protocol. 

The purpose of the paper is to extend the arguments proposed in Ref. [l8| and to give the shortest general proof of 
this result (Section IIII[) . which at the same time also applies to classes of non-Markov models fSection IIV[) and for 
which the diffusion limit becomes equally simple (Section [Vj) . At the end we put the result into a broader context 
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by showing that the time-dependent protocol under consideration in arbitrary (in general nonequilibrium) systems 
modifies all currents by a global multiplicative factor (Section IVII) . We start with the general set-up in terms of a 
Markov jump process. 



II. SET-UP 



Markov state models and their extensions are important tools for modeling thermodynamic processes of open 
systems [T^ | and they find numerous applications in chemical kinetics [l9l - l22j and in bio-chemistry (23j . 

In our abstract framework we use x,y, . . . to denote the long-lived or metastablc states that locally minimize a given 
free energy landscape G a {x) under equilibrium conditions; for instance, they refer to chemo- mechanical configuration 
of molecules within a suitable coarse-grained level of description. Together, they form the vertices of a stochastic 
network with bonds between pairs (xy) indicating possible transitions. The dynamics is encoded in the transition 
rates w a {x,y) satisfying the condition of detailed balance 

e~ G ^ w a (x,y) = er G «^ w a (y, x) (1) 

with the free energies G a in ksT units. The index a indicates a possible dependence on an externally controlled 
parameter which varies the depth of the local free energy minima G a (x). Detailed balance ((l) implies that for fixed 
a the dynamics (by assumption ergodic) relaxes to the equilibrium Gibbs distribution oc exp[— G a (x)}. 
As indicated before, we restrict ourselves to a protocol that makes the transition rates, 

w t (x,y) = A(x,y)e G ^ x \ A(x, y) = e" A ^) (2) 

time-dependent via the parameter a = a(t) in the free energy minima G a . A(x, y) = A(y, a;) are the effective barrier 
heights which arc kept fixed. In general, A(x, y) just specifics the Arrhcnius prcfactor in the transition rates and 
A(a;,j/) deviates from a true barrier energy by geometrical corrections. However, a good approximation in many 
applications is to consider G(x) and A(x,y) as independent in the sense that they can be manipulated independently 
from each other by suitably varying the minima and the barrier heights respectively. 

It has been shown in [161 ] that no energy pumping is possible for such systems in the following sense. Let p t be the 
instantaneous distribution function and let jt(x,y) be the corresponding instantaneous mean current between pairs 
of states, 

jt{x,y) = p t (x)w t (x,y) - p t (y)w t (y,x) (3) 
as obtained from the Master equation written in the form 

dp t {x) 



dt 



+ X>(z,|/) = (4) 



There is no strictly stationary distribution as the rates are time-dependent, but when the protocol a(t) is periodic in 
time, we expect to find that p t itself becomes periodic in time, at least for sufficiently large times t. In any event, we 
can define the time-averaged current 



J(x,y) = limi / j t (x,y)dt (5) 



and the no-pumping theorem states that this long-time average equals zero for all pairs of states x, y. Thinking of 
independent particles hopping on the network over x —> y with rate Wt(x,y), the no-pumping refers to having no net 
time-averaged flow of particles between any two nodes x and y. 



In the next section we present a simple derivation of this result within the present set-up of Markov state models. 
Later sections will provide extensions to the semi-Markov and the diffusion systems, giving the main results of this 
paper. 
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III. NO-PUMPING THEOREM 



Before starting with the proof we remind the reader of two important facts. First of all, the no-pumping theorem 
is only valid for some specific types of time-dependence — in general for those considered in © . Even when the rates 
are satisfying the condition of detailed balance ([I]) for each fixed value of the parameter a, there is no a priori reason 
why there could not arise a net current J(x,y) in the process with time-dependent a(t). In fact, that is exactly what 
happens in so called flashing (and other) ratchets where the change in the potential landscape produces a net flow of 
particles [24j . For example, a system (like a ratchet) with transition rates 

w t {x,y) = A(x,y)e~^y)-^\ A(x,y) = A(y,x) 

also satisfies detailed balance (HJ for each fixed time t and can be written analogous to (0) as 

w t (x,y) = e Gt(*)-A t (x,j,) 

but the effective barriers A t (x,y) = [Gt(x) + Gt(y)]/2 — In A(x, y) have become time- dependent. Within the framework 
of the no-go theorem there is absolutely no reason now that the net currents would be identically zero (unless further 
symmetries are imposed). 

Secondly, the geometry of the stochastic network is certainly relevant for the possible generation of a current. In 
fact, the net current j t (x,y) dt over any edge (xy) connecting two otherwise disconnected subgraphs is a total 
time-difference of the form NT(x,y) — No(x,y) and hence automatically approaches zero when time- averaged as in 
([5]). Thus Wt(x, y) can be arbitrary (= no restriction) over such a "bridge" and the restricted form of time-dependence 
as in ([2]) is only required over those edges (xy) which belong to a loop. 

We now come to our formulation of the no-pumping theorem. Consider the class of Markov jump processes with 
states x, y, . . . as in Section [TTJ For all bonds (xy) in our stochastic network that are part of a loop in the network we 
require that the time-dependence in the transition rates is of the form 

w t (x,y) = X t (x)p(x,y) (6) 

where Xt(x) = Wt(x 1 y) is the time-dependent escape rate and p(x, y) is a time-independent transition probability; 
p(x, y) > 0, ^2 y p(x, y) — 1. We assume that the matrix [p(x, y)] is irreducible so that there is a unique left eigenvector 
/i for eigenvalue 1: ^ x n(x)p(x, y) = p(y). (That is automatically so when the network of states is connected via 
p(x,y) > — Perron-Frobenius theorem.) We also assume detailed balance, i.e., for some potential V, 

e- v{x) p(x,y)=e- v{y) p(y,x) (7) 

so that in fact fj,(x) cx e~ v ( x \ Finally, we suppose that the limit 

1 f T 

w(x) = hm - p t (x) \ t (x) dt (8) 

exists. (That is automatically satisfied when the timc-depcndcncc is periodic but, clearly that is not strictly necessary.) 

The no-pumping theorem is now easily proven as follows. Since the full time evolution is obtained by solving (|3|)-(j4|), 
the time integral of the latter gives 

= 1 TT / T ^ dt = -E J ^y) ( 9 ) 

V 



and 

J(x,y) = w(x)p(x,y) - zv(y)p(y,x) (10) 

where we have inserted condition Hence, w ( x ) p( x , y) = ^(v), which is the stationary Master equation for a 
time-independent Markov chain with (unnormalized) distribution w and current J. By irreducibility and by detailed 
balance ([7]), the equations (P?j)- (fTt))) have the unique solution 

w(x) oc e~ v{x \ J(x,y) = (all pairs) (11) 
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as was to be proven. 

The conditions ©-([7]) are just equivalent to ((I])-© and, hence, the above theorem can immediately be applied 
to the situation of Section HU Specifically, for a system with free energy wells G a (x) and effective energy barriers 
A(x, y) = A(y, x) as in @, we consider an arbitrary cyclic path a(t) = a(t + T) with some period T. Keeping the 
energy barriers constant, the condition ^ is verified with time-dependent escape rates 

X t (x) = e G ^ ^ e -A(^) 
y 

and time-independent transition probabilities 

e -A(x,i/) 

satisfying detailed balance ([7]) for V(x) = — \nJ2 y e~ A ( x ' v \ 

As a summary, the essential ingredients are two-fold. First, the original time-dependent jump process is detailed 
balanced for each fixed t, and secondly, the transition rates can be decomposed into a product of time-dependent 
escape rates Xt(x) and time-independent transition probabilities p(x,y). 

The idea of the proof above, at least for a periodic time-dependence, is that the time-averaged current in the 
original system ([2]) exactly coincides with the stationary current in a temporally coarse-grained system with transition 
probabilities p(x,y). As the original process is detailed balanced for each fixed time, the stationary coarse-grained 
process is time-reversal symmetric and therefore the net current in the original process vanishes. 

As a final comment, it is important to realize that the vanishing of the net (i.e., time-averaged) current, J(x, y) = 0, 
does not imply that j t (x,y) = at each time, unless the process runs in the quasistatic regime. Related to that, the 
overall dissipation does remain nonzero in general. For this it suffices to look at the time-averaged entropy flux 

EF = ^V 3t[x,y)ki — ^- -di>0 

We refer e.g. to Section 3 in Ref. [25| for putting this expression for the entropy flux in a thermodynamic context. 
Inserting (fT]) we compute 

over the average work (dG Q ( t )/di) Pt = ^ x pt(x) dG Q ( t ) {x)/dt. Only in the quasi-static (or adiabatic) limit when we 
can take pt(x) ex exp[— G Q ( t )(x)] do we get that (dG a ( t )/dt) Pt = — d/dt In ^ x cxp[— G a ( t )(a;)] and is the entropy flux 
EF = 0. 



IV. NON-MARKOV GENERALIZATION 



By the simplicity of the proof above the arguments allow a natural extension to more general jump processes 
including those with non-exponential waiting time distributions. These are called semi-Markov systems or continuous- 
time random walks, here on the chemical network. The fact that the presented method survives here is important, 
especially since many biophysical and biochemical processes are believed to be essentially non-Markovian for a 
natural choice of states [26| . 

We consider a jump process for which the main change with respect to the Markov case consists in its dependence 
on the time to of the previous jump. In that way, given that the system is in state x at time t since its last jump to 
x at ioj the probability that the next jump occurs within the time-interval [t,t + dt] is given by X(x; to, t) dt. (The 
Markov case corresponds to X(x;to,t) = Xt(x).) The probability rate that the next jump goes to y is then 

w(x,t ;y,t) = X(x;t ,t)p(x,y) (13) 

generalizing the time-dependent Markov transition rates ((6]). We keep the same assumptions on the transition matrix 
[p(x, y)], with its most important property being the condition of detailed balance ([?])• The p(x,y) define what is 
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often called the embedded Markov chain. The complication of the memory present in the escape rates X(x;tQ,t) 
turns out to be irrelevant for our proof of the no-pumping, as we now show. 

The probability density that at time t the system is found in state x and that the last jump before t occurred within 
[to, to + dto] is denoted by p(x; to, t) dto — it relates to the standard single-time distribution as 

p t (x) = / p(x;t ,t)dt 
Jo 

The mean current j(x,to;y,t) dto counts the expected rate of (directed) jumps x y at time t when the previous 
jump occurred in [to, to + dto]: 

j(x, t ; y, t) = p(x; t , t) w(x, t ; y, t) - p(y; t , t) w(y, t ;x, t) 

It is related to the standard mean current as 

3t(x,y) = / :)(x,to;y,t)dto (14) 
Jo 

By construction, the single-time quantities pt and jt satisfy the balance equation 

dpt(x) 



Y,Mx,y) = (15) 



dt 

v 

We proceed analogously as in the Markov case. We assume that the limiting quantities 



m(x)=\im^- / p(x;t ,t)X(x;t ,t)dt dt (16) 
T 1 Jo jo 



1 ' T 



are well defined. Then again, 
and from integrating (|15[) . 



J(x,y) = lim- / j t {x,y)dt (17) 



J(x,y)= w{x)p(x, y) - zu(y)p(y, x) (18) 



£j(*,y) = (19) 

y 

By detailed balance ([7]) we reach the conclusion J(x, y) = which ends the proof. As before, time-homogeneity and 
detailed balance of the embedded Markov chain imply that the net flux through any pair (xy) asymptotically goes to 
zero. 



V. DIFFUSION LIMIT 



The same ideas apply to diffusion processes. We can obtain them as continuum limits of Markov jump processes. 
For simplicity we assume here that the stochastic network is a one-dimensional chain, possibly turned into a circle. The 
lattice spacing is denoted by e and we will take the continuum limit e — > 0. We think of the transitions as the hopping 
of a random walker between nearest neighbor sites x — > x ± e with rates depending on space- and time-dependent 
amplitudes D t (x) and a potential Ut(x): 

W e (x, X±e) = £- 2 yjD t {x)D t {x ± 7) e \Ut{x)-U t (x±e)]/2 

i (20) 
= e- 2 D t (x) ± - e^Dtix) [In A - U t ]'(x) + 0(1) 

by expanding around e = and with 0(1) indicating an error term that remains bounded along e — > 0. As in (j6]) 
we decompose these transition rates w e (x,x ± e) into a product of escape rates \l(x) and transition probabilities 
p e {x, x ± e), to find 



\\{x) =2e- 2 D t (x) + 0(l) 
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and 

Pe(x,x± e) = \ ± I [In A - U t }'(x) + 0(1) 

= I e mx)-n^)]/2 + 0(1) 

under the condition that V = C/* — lnD t does not depend on time. That then reproduces the form ^ under which 
the no-pumping holds. This comparison to jump processes predicts under what natural condition we may expect 
zero net current also for diffusions. Next we give a direct argument that confirms this idea. 



We are now dealing with a Langevin-type equation in ltd form 



dx t = -D t (x t ) U' t (x t ) dt + D' t (x t ) dt + y/2Dt(xt)dBt (21) 

where dB t / dt indicates standard white noise. That describes an overdamped one-dimensional diffusion on a ring (for 
periodic boundary condition) or on the line, in a time-dependent potential landscape Ut(x) and with time-dependent 
diffusion parameter D t (x) (setting the environment temperature equal to one). 
The corresponding Fokkcr-Planck equation reads 

dpt{x) I i'(x)-Q 

dt + ^~ U (22) 

j t (x) = - Pt {x) D t {x)U\x)-D t {x)p' t {x) 



The same ideas as above can now be applied. As before we define the quantities 

1 f T 

w(x)=\\m— I p t (x)D t (x)dt 
T 1 Jo 

and the time-averaged current 



t T 



J(x) = lim 1 jf [-pt D t V'(x) - (p t A)'] dt 
= -w{x)V'{x) - w\x) 



(23) 



J(x) = lim^ / j t (x)dt (24) 



By time-integrating ((22]) we reach the stationarity condition 

J'(x) = (25) 
For "effective" potential V = Ut — In A and assuming that V is time-independent, one gets 



(26) 



As a consequence, the time-averaged characteristics of the original process (|21[) coincide with the stationary 
characteristics of a time-independent detailed balanced diffusion in the potential landscape V with unit diffusion 
parameter. Therefore, w(x) cx exp[— V(x)] and J = is the (unique) solution. 



We conclude that for diffusion process with only gradient forces the condition 

|(Ae-^) = (27) 

is sufficient for the vanishing of the average current ([2~4"]l. We recognize in (j2"T)l the condition for time- independence 
of the transition probability p e {x,x ± e) of the random walk in (|2ip . Our result also agrees with the no-pumping 
condition found previously by a more complicated method [l7| . A no-pumping theorem for a general Langevin process 
on a compact manifold of arbitrary dimension was given in Ref. [l8l . using a method similar to the above. 
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VI. NONEQUILIBRIUM GENERALIZATION 



A natural question arises how the extra time-dependence affecting only the energy wells or escape rates like in ^ 
modifies the long-time characteristics of a general nonequilibrium system with steady currents already present. We 
answer here that question by generalizing the above argument, restricting ourselves to the case of jump processes 
( Section IIII[) . This will throw more light into the nature and robustness of no-pumping theorems. 

As before in ([2]) we start from transition rates 

w t (x,y) = w(x,y)e Gt ^ (28) 

with time-dependent energy function Gt(x) = G a (t){x) but now we do not assume detailed balance for the ref- 
erence process with rate w{x 1 y). That reference could thus very well correspond to a driven nonequilibrium but 
time- homogeneous system. Let p s (x) be the stationary density of the reference, with steady currents j s (x,y) = 
w(x,y)p s (x) - p s (y)w(y,x), J2yf( x :V) = °- 

Inspecting formulas (P|)- ([TT|) . we find that the long-time averaged current is 

1 ' T 



J(x,y) =lim — y j t {x,y)dt 



= w(x) w(x, y) - zsj(y) w(y, x) 

with 



i r T 

w{x) =lim- / p t (x) e Gt{x} dt 



and satisfying the stationarity condition in all nodes: 

Y,J(*,y) = o (30) 

v 

By the assumed ergodicity, the equations (|2T)]) - ([5U| have a unique solution in the form 

m(x)=top\x), J(x,y)=nf(x,y) (31) 

with the normalization 

i-T 



n = lnniW p t {x)e G ^dt 

™ J 



(32) 



Hence, we have arrived at an important conclusion: For the time-dependent protocols under consideration, the time- 
average current (|29[) is merely a global multiplicative factor of the reference steady current. If the latter is zero, there 
is also no resulting pumped current and we recover the original results. 

Remark that the ergodicity assumption is not essential: In general, the dynamics decomposes into several ergodic 
components made of mutually connected states. Within each of the components, the reference stationary distribution 
p s is unique and the above argument readily applies, up to that the current multiplicative factor f2 is now generally 
different for each component and it depends on the initial distribution pq. 

In the case of a quasi-static process the system passes through the states 

Pt(x) = ^-p s (x)e- G ^\ Z t = J2P S & e ~ Gt(X) ( 33 ) 

X 

which are stationary with respect to the instantaneous energy landscape Gt- Indeed, these distributions correspond 
to the currents jt{x,y) = j s (x,y)/Z t such that jt{x,y) = 0. The normalization factor (|32p then becomes 

1 f T dt 



^ = ^tI - (34) 



One also checks that the total dissipation as measured by the time-integrated outgoing entropy flux (|T2l) gets modified 
by the same factor CI (but only) in the adiabatic limit. 
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VII. CONCLUSION 

The no-pumping theorem relies on the decomposition of the jump rates into a time-dependent escape rate and a 
time- homogeneous stochastic matrix (embedded Markov chain). Then, time-integrated currents depend on the given 
time-dependent protocol only via a global multiplicative factor. When the embedded Markov chain satisfies detailed 
balance, the no-pumping result appears. 

While the temporal coarse-graining can indeed express the original time-integrated current in terms of the steady 
current for the embedded Markov chain, that is not true for the dissipation or entropy flux which remains nonzero even 
in case the embedded Markov chain is detailed balanced. The same ideas and methods of proof apply to semi-Markov 
processes and to the diffusion limit. 
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